A neural architecture search based framework for liquid state machine design
نویسندگان
چکیده
Liquid state machines (LSMs), also known as the recurrent version of spiking neural networks, have garnered significant research interest owing to their high computational power, biological plausibility, simple structure, and low training complexity. By exploring design space in network architectures parameters, recent works demonstrated great potential for improving accuracy LSM models with However, these are based on manually defined or predefined which may ignore optimization parameters LSMs. In this study, we propose a architecture search-based framework explore parameter automatic dataset-oriented models. To manage exponentially increasing space, adopt three-step search LSMs, including dynamic multiple-liquid multiple layers, variations number neurons each liquid, such percentage connectivity excitatory neuron ratio within liquid. addition, use simulated annealing algorithm implement heuristic search. Two datasets, image dataset NMNIST speech FSDD, were used test effectiveness proposed framework. Simulation results that our can produce optimal The best classification two datasets only 1000 was observed be 92.5% 84%. Meanwhile, connections discovered average, reduced by 56.3% 60.2% separately compared single LSM. Furthermore, total 20% an loss 0.5%.
منابع مشابه
Codification conceptual framework of education for students in architecture Primary design studios: A qualitative content analysis
Coordination of education categories and activities of novice students in architectural primary design studios is indispensable and can lead to the designing ability development and transition towards professionalism and proficiency. The objective is a conceptual framework for architectural education based on the categories of architectural education and novice studentschr('39') activities in a...
متن کاملLiquid State Machine Optimization
In this thesis several possibilities are investigated for improving the performance of Liquid State Machines. A Liquid State Machine is a relatively new system that is a Machine Learning system, which is capable of coping with temporal dependencies. Basic Recurrent Neural Networks often have problems with this. One reason for this is that it takes a long time to train the Recurrent Neural Netwo...
متن کاملLocation-based services: A framework for an architecture design
Location awareness describes applications in computing and telecommunications, which alter their behaviour in dependence on the location of an entity, such as the user of an application, a person the user of the application wants to communicate with, or an object capable of changing a location. Such location presents a major category of context and it is derived by various methods of positionin...
متن کاملPREDICTION OF SLOPE STABILITY STATE FOR CIRCULAR FAILURE: A HYBRID SUPPORT VECTOR MACHINE WITH HARMONY SEARCH ALGORITHM
The slope stability analysis is routinely performed by engineers to estimate the stability of river training works, road embankments, embankment dams, excavations and retaining walls. This paper presents a new approach to build a model for the prediction of slope stability state. The support vector machine (SVM) is a new machine learning method based on statistical learning theory, which can so...
متن کاملA Differential Evolution and Spatial Distribution based Local Search for Training Fuzzy Wavelet Neural Network
Abstract Many parameter-tuning algorithms have been proposed for training Fuzzy Wavelet Neural Networks (FWNNs). Absence of appropriate structure, convergence to local optima and low speed in learning algorithms are deficiencies of FWNNs in previous studies. In this paper, a Memetic Algorithm (MA) is introduced to train FWNN for addressing aforementioned learning lacks. Differential Evolution...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neurocomputing
سال: 2021
ISSN: ['0925-2312', '1872-8286']
DOI: https://doi.org/10.1016/j.neucom.2021.02.076